Global Convergence Properties of Conjugate Gradient Methods for Optimization

This paper explores the convergence of nonlinear conjugate gradient methods without restarts, and with practical line searches. The analysis covers two classes of methods that are globally convergent on smooth, nonconvex functions. Some properties of the Fletcher-Reeves method play an important role in the first family, whereas the second family shares an important property with the Polak-Ribire method. Numerical experiments are presented. Key words, conjugate gradient method, global convergence, unconstrained optimization, largescale optimization AMS(MOS) subject classifications. 65, 49